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Abstract 

The notion of complex-valued information entropy measure is pre- 
sented. It applies in particular to directed networks (digraphs). The 
corresponding statistical physics notions are outlined. The studied net- 
work, serving as a case study, in view of illustrating the discussion, con- 
cerns citations by agents belonging to two distinct communities which 
have markedly different opinions: the Neocreationist and Intelligent De- 
sign Proponents, on one hand, and the Darwinian Evolution Defenders, 
on the other hand. 

The whole, intra- and inter-community adjacency matrices, resulting from 
quotations of published work by the community agents, are elaborated and 
eigenvalues calculated. Since eigenvalues can be complex numbers, the in- 
formation entropy may become also complex- valued. It is calculated for 
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the illustrating case. 

The role of the imaginary part finiteness is discussed in particular and 
given some physical sense interpretation through local interaction range 
consideration. It is concluded that such generalizations are not only in- 
teresting and necessary for discussing directed networks, but also may 
give new insight into conceptual ideas about directed or other networks. 
Notes on extending the above to Tsallis entropy measure are found in an 
Appendix. 

keywords : Entropy - Citation networks - Asymmetric adjacency matrix 

1 Introduction 

"Complicated systems" are usually, but abusively [1], called complex systems. 
Recall that complex numbers are found in physics to describe various macro- 
scopic properties: the dielectric permittivity, the electric impedance, the ampli- 
tudes and phase angles of modal vibrations, Magnetic Resonance images, etc.. 

Complex eigenvalues (EVs) do naturally occur in a Hamiltonian formalism: 
the imaginary part of some self-energy which turns out to be the "density of 
states" , localization in superconductors [5] , dissipation and scattering in Quan- 
tum Chaos [6, 7] or Quantum Chromodynamics, with a non-vanishing chemical 
potential [8], fractional Quantum Hall Effect [9], two-dimensional plasma of 
charged particles [10, 11]. See also the imaginary part of the "free energy" mea- 
suring the quantum decay rate of a pure state or the imaginary part of power 
law exponents describing oscillations in the specific heat or in the electrical 
resistivity temperature derivative at (magnetic, for example) transitions [3, 4]. 

It will be argued below that one modern case of interest is the entropy of 
directed networks: it can have a real and an imaginary part. For coherence, 
the definitions of the thermodynamic and the information entropy measure are 
recalled in Sect. 2. Subsequently the complex information entropy measure 
(CIE) is defined in order to take into account complex algebra, when or if 
necessary, - in particular when discrete "states" are considered. In Sect. 3, 
a brief outline of some illustrating case is presented. It concerns a citation 
network, - see Sect. 3.1. The entropy of such digraphs can be complex, following 
some illustrative calculation. A preliminary interpretation follows in Sect. 3.2. 

Some conclusion is found in Sect. 4. A discussion on normalization is found 
in Appendix A. An extension to Tsallis entropy measure is suggested in Ap- 
pendix B. A long but useful discussion on the origin of complex EV for citation 
and similar asymmetric networks is found in Appendix C, where the various 
cases of the most simple asymmetric networks, i.e. triads, described by 3x3 
matrices, are used to point to transitivity causes. 

2 Complex- valued information entropy measure 

The typical statistical mechanics approach starts from the partition function Z 
defined through the sum of all the Boltzmann factors measuring the probability 
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of occurrence of the various states of a Hamiltonian H. The partition function 
rebels 

Z 8 (T) = S^ 1 e-W' v ). (1) 

when observing a system at a scale s and at some temperature T (/3 = l/fc^T); 
^ (= 1, ...,N S ) is an index allowing to label and to count the configurations of 
the relevant degrees of freedom governing the system. One can next derive the 
corresponding free energy F S (T) = —ksT ln(Z s (T)). This free energy is known 
to be a homogeneous function at critical points [14], in the scaleless situation. 
This leads to define (real) critical exponents [15, 16]. The scale of interest is 
in fact related to the coherence length, £, itself temperature dependent, giving 
some measure of the "temperature distance", e = (T — T c )/T c , between the criti- 
cal temperature T c and the system temperature T. Practically, one can map the 
model Hamiltonian H over the possible states, through e~^ w . Without justify- 
ing much here, i.e. going back to the theory of Markov processes, we admit that 
the latter is a so called transfer matrix [17], with elements made of Boltzmann 
factors. Thereafter we can calculate the eigenvalues Aj and evaluate Z, F, and 
S, i.e. e- fjn -> e-' 3E -> e~ pXi -> Z -> F -> ~ Ai -fc s T (l + e-^-AO + ) 
— > 5. Often, the first eigenvalue Ai is sufficient to obtain an estimate of the 
free energy. So called "corrections" imply higher order terms [18], though one 
often stops at A2. Thus, any (thermodynamic) property, x(s,T), derived from 
F S (T) ~ F(£(e)), can have the form x(e) ~ £ r (e), but where r can be complex 
[19, 20]. In some sense, this is as if F is complex, or if some Aj is complex. 

Wc interpret an adjacency matrix, e.g. describing a network, as a transfer 
matrix, - written in terms of some Hamiltonian TL. However, we are aware 
that such an H is not necessarily a bona fide Hamiltonian, i.e., from a quantum 
mechanics point of view, since it might not be hermitian. The eigenvalues can 
thus be complex. 



2.1 Real algebra information entropy measure 

The Boltzmann entropy in statistical physics [12] reads: 

poo 

S = - dwN(w,t)\ogN(w,t). (2) 
Jo 

where N(w,t) is the number of states, of type w, at time t. This entropy 
corresponds to the usual Shannon information entropy which can also be written 
in terms of the (equilibrium) probability pi of finding some (macroscopic variable 
in some) state i, 

H = -k B J2Pi ln Pi ( 3 ) 

i 

Since pi is necessarily positive but less than 1, H > 0, - like a Boltzmann factor. 

Often, pi is practically known through some a priori bin decompositionof 
the distribution of states. This is similar to the Theil approach in economy 
[21, 22, 23], where the individual incomes are taken into account, normalized to 
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the income of the whole population of interest in the study. Thus, in the above, 
some generalization would replace pi by X{. 

Having in mind applications to network theory, one might argue that the 
most adequate normalization should take into account the size of the system 
(or the adjacency matrix). In the Theil spirit, one could imagine various nor- 
malizations, see Appendix A. This can be considered elsewhere depending on 
specific applications. 

Thereafter, the Information Entropy (IE) is defined, as in [24, 25], by 




in units where ks = 1, and where A, is the i-th eigenvalue of the relevant matrix 
of size ImxIjj. However, one may, without much loss of generality, decide that 
the log-basis is the natural one, rather than one being associated with the matrix 
size, i.e. to keep a thermodynamic-like spirit, and redefine for our purpose, 




to emphasize that we the natural log. Nevertheless, for simplicity, the index e 
will not be further written. 

In concluding this section, let us introduce the notation Hi = 1 + ^ In ^ . 

° ' Im Im 

such that it should correspond to an estimate of the IE based on the largest 
EV. 



2.2 Complex information entropy measure 

In fact, let Im is the number of available states, or the number of EVs for some 
Hamiltonian or transfer matrix or adjacency matrix. Since the Im eigenvalues 
could be complex, one has to generalize the previous formula, Eq. (5) to the 
complex plane, i.e. H = H + i H , such as one gets 



H ' = 1 + V M f [In M] [cos^i)} - [($< + i n 2tt) sin^i)}) , (6) 

, l-M \ I At J 

and 

H " = J- M A ln J|M] [sin ($.)] + [($. + i n 2n) co8($i)]) , (7) 

, l-M V l M J 
i— 1 v 7 

where we identify any A i + i A i with ||Aj|| [cos($i) + i sin($j)]. Note that from 
these, the magnitude \\H \\ of the complex information entropy, as well as the 
IE phase factor, could be calculated. The i n 2tt term is due to the fact that 
the argument of log Aj is a multivalued function [2]. Therefore, for meaningfully 
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pursuing any calculation, it is necessary to define the existence interval of the 
argument of such a complex number. One can decide that $i is defined in 
< < +27r, or in — it < $i < +ir, i.e. the so called "principal value" 
(PV) component [2]. 

Thus, when doing the summations in Eq.(6) and Eq.(7), several terms may 
cancel each other. In particular, when either tan($i) is even or when 
$i cotan(^i) is odd. This depends on whether two EVs are complex conju- 
gates, and in the appropriately defined space of $i. Then, the above formulae 
can be simplified through some trivial algebra when taking into account the 
form of the eigenvalue. 

Whence, starting from Eq.(5), let us distinguish between the real positive 
(p), real negative (v), imaginary (/i), equal to zero, and complex- valued (A) 
eigenvalues. One can rewrite Eq.(7), with obvious notations for each sum upper 
limit, 

Pm vm Pm Am , ^ 

^ = 1 + EA ln A+E7^ ln 7^+Ef iln f i +Er iln 7^- (8) 

, Im i-m i-M Im Im l-M r—? Im Im 

i—i i—i i—i t—i 

The first sum is trivially real, for any interval definition of $i. In fact, 
Pi = INI- 

When an EV has some finite, in particular if it is negative, real or imaginary 
part, several cases must be distinguished. The case of degenerate EVs has also 
to be specially considered. Note that if an EV is evenly degenerate, it can be 
considered as stemming from a set of c.c. EV with a zero imaginary part. Then, 

In depends on which complex sheet ("interval space") the phase factor is 
defined. 



2.2.1 e [0, 2tt[ space 

• When v i = -||^||, and v'l = 0, one has Vi = e J7r+2n * 7r ; the second sum- 
mation has thus terms like ^ In = Zn[^] + (2n + l)i [tt] . 
Such a term contains a real and an imaginary part. The n = case is of 
course in order here below, i.e. P- In P- = — Ui^l ^rJliilll — i^lli M 

Im Im Im l Im j 'm 1 J 

• In the third summation, the imaginary part n i could be positive or neg- 
ative, i.e. fii = i ^ = ±i\\fj,i\\; the phase factor is [^j and [^f] , respec- 
tively. Thus, a term in the third summation reads either 



+i 



II/'-- 



i„(JIM) +i [*] 

I'M 2 j 

x lM ' L 2, J L 2 J l M IM y IM ' 



[7Tl \\Pi 

[ 2i l M 



+ 1^ ln( 

Im v 



ll^ll 



or — «• 



hi 



lM ' A \ 'M 'M I'M 

Therefore, in the summation, extending over the whole number (/im) of 
imaginary, - but necessarily (c.c), EVs, we insist, only a real term subsists 
in H after summing over c.c. EVs, i.e. + 11^11 k/Im- Note the + sign. 
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• Let A;' = ||Ai|| [cos{$i)+isin{$i)] = \\\i\\ e+ 4 **. Thus, A^' 

[cos($j) - i sin(<$>i)} = ||Ai|| e +i ^-^\ One has, 



JIM ; n ll^ll 

Im Im 



II A, II 



+ i 



\M 

Im 



$i cos($i) + In^^-sin^i) 



But when A = A,- — i A, , one has ^hA /n-r 



if A = A, +z A, . 



A* II 



II A, II 

Im 

JIM 

Im 



cos(<S> 1 ) In^A + (2tt - $i) sm($i) 



(27r - $,) cos($i) - ?n^^ sm($j) . Therefore, the fourth sum- 



mation can be simplified; after grouping c.c. terms, as indicated by the 
notation y\, it reads 

+* E- 27T^ COS (<I> l )- 



+ 



One can rewrite the real and imaginary parts of the IE such that, 



Pm 



H 



TC 



i + y^ JJMl 

1=1 

E 



In(ip) 



+ 



E 



^E 



(9) 



and 



TC 



= E 



^ 7T 



'm 



+E 2n i^ cos ^- 



(10) 



2.2.2 Principal Value (PV) space : $; e ]-7r, 7r] 

• When ^ = ||, and = 0, one can obtain, as in TC space, f^lnf^ 



= MM 

Im 



ln[ 



Ik, lh 



Ik, II 

Im 



I 7T . 



• Recall that in the third summation, the imaginary part [i i could be posi- 
tive or negative, i.e. Hi = i fi i = ±i\\fj,i\\. In PV space, the phase factor is 
[^j and [— f], respectively. Thus, a term in the third summation reads 



either 



or 



Ik.ll 



G 



Therefore, in the summation, extending over the whole number (pm) of 
imaginary, - but necessarily c.c. EVs, we again insist, only a real term 
subsists in H after summing over c.c. EVs, i.e. — \\fti\\ tt/Im- Note the — 
sign. 

Because A ■ ± i A-' = ||Aj|| [cos($i) ± i sin($j)] = ||Aj|| e ±, * i , terms like 



i 

II VI 
Im 



[cos(<Pi) - $ 4 sin($i)} ± i[$ i cos($ J ) + sm($;) In^] 

Taking into account that the A EVs are necessarily c.c, the fourth sum- 
mation can be simplified into a real quantity, after grouping c.c. terms, 
as indicated by JV, i.e. 



JIMi 



E,2 



_k /n iM_<i>.^ 

Im Im »m 



which also reads 



El 2^ [aM($0 Zn^i - ^sin^i) . 
One can regroup the real and imaginary parts such that finally, 



H 



and 



PV 



V M II || 



ln(M) 
Im 



+ 



E - 



'M 



tM *M <M 



H 



PV 



E 



tM 



(11) 



(12) 



It can be observed that H PV can have any sign. However, H PV is necessarily 
< 0. Moreover, if the EV of type v is evenly degenerate, it has to be recognized 
that such EVs are equivalent to a c.c. EV, with zero imaginary part. Thus, 



In 



IK II 



ln[^] ± 



]K_iU M Therefore, the summation over such 
and leads to a zero imaginary part 



Im 



Im 



Im Im Im l Im j Ia 

degenerate EVs is equal to —2 
contribution. 

Note also that if the Principal Value (PV) space is rather the PV space 
such that G [-it, tt[, one would obtain p- In = ln\ 1 ^} + i \ir] 

Im Im Im 1 Im 1 1 Mm ' 
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instead. Appropriate modifications would have to occur when writing H PV , and 
H pv ,. Yet, the contribution of evenly degenerate negative EVs would still lead 
to a vanishing contribution to H pv , . 

To verify the above formulae and conclusions, it can be also usefully checked 
that the v and p, cases can be obtained as special cases of the A case. 

3 Data 

Let us consider a numerical example covering various cases among complex (= 
complicated) networks. These have been used to depict the characteristics of 
various abstract systems. The network nodes can be motifs or agents, while the 
links can be directed or undirected, weighted or not. 

Among directed networks [26, 27, 28, 29, 30, 31, 32, 33, 34, 35, 36, 37, 38, 39], 
a special class is the citation networks [40, 41, 42, 43], which is called a digraph. 
Digraphs are surveyed in [44]. 

Due to the intrinsically time dependent hierarchical process, the adjacency 
matrix representing the network is usually asymmetric, beside being a non- 
negative matrix. There is a large body of mathematical work on spectra of 
adjacency matrices, ranging from modern versions of Perron-Frobenius theorem 
for non- negative matrices [45, 46], - up to recent results reviewed by Brualdi 
[47] and others like [48, 49, 50, 51, 52, 53]. 

For the following, let it be recalled that a square matrix M. is so called 
irreducible if D(Ai), the corresponding network is strongly connected, i.e. a 
path exists between any couple of nodes. Otherwise M is said to be reducible. 
Let Ai > be an irreducible n x n matrix. Then, Ai has a positive real 
eigenvalue equal to its spectral radius p(A4). An irreducible nonnegative matrix 
M is said to be primitive, if the only eigenvalue of M of modulus p(M) is 
p(M). An irreducible nonnegative matrix A4 is said to be cyclic of index k > 
1, if it has k eigenvalues of modulus equal to p(AA). 

To illustrate the arguments leading to the CIE theory, we have therefore 
selected a citation network, previously studied along other lines [42, 43], but 
presenting a set of adjacency matrices containing quite a variety of features, in 
particular with respect to the EV distributions. 

It might be useful to the reader to consider the case of the smallest asym- 
metric adjacency matrix, with zero on the diagonal for reasons given below, 
discussed in Appendix C. Even though it might look surprising to discuss a 3x3 
matrix in a modern scientific paper, the illustrations found in the Appendix 
have been found to be the most simple ones leading to the appreciation of the 
EV behavior of large random matrices. Indeed such matrices correspond to 
complicated networks from which it is not often possible to easily observe the 
key features. 
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3.1 A 77x77 real asymmetric matrix 



Consider the citation network first studied in [42], with adjacency matrices 
given in [43], according to the outcome from a Scholar Google search process. 
The citations are those of agents belonging to two quite distinct communities, 
composed of modern creationists (most are Intelligent Design (ID) proponents 
(IDP), on one hand, and Darwin's theory of Evolution Defenders (DED), on the 
other hand. The network [43] is composed of two subgraphs, one with 37 and 
the other with 40 elements, or nodes, or agents, corresponding to the IDP and 
DED community, respectively. The adjacency matrices can be summarized as 



in which a matrix element takes the value 1 or depending on whether 
or not a citation of i by j has taken place, as recorded and explained in rcf. 
[42, 43]. The matrices C (37x37) and D (40x40) indicate whether agents of 
community i have been quoted by others of the same community i. In contrast, 



emphasizes links between different communities, i.e. agents of community j 
quoting those of community i(^ j); i j. A and B are obviously rectangular 
matrices describing inter-community links. We emphasize with the o index that 
all diagonal terms in Mo, Co, and Do are 0, i.e. we are not considering any 
self-citation, i.e. mu = 0. In brief, there are 91, 71, and 119 links, in IDP, DED 
and inter-community ones, respectively. All adjacency matrices, as well as Mo 
and F are markedly asymmetric and contain only real and positive numbers, 
or 1; sec [43] for the list of all finite matrix elements. 

Moreover, since each square matrix Mo, Co, Dq, Fo has non- negative ele- 
ments, the Perron-Frobenius theorem, see above, states that there exists a non 
negative eigenvalue greater or equal in absolute value than all other eigenvalues 
(and its corresponding eigenvector has non- negative components) [54, 55] . 

We have tested the hypothesis of irrcducibility of these matrices. Since the 
property of irreducibility is equivalent to the property of the adjacency matrix 
corresponding to a strongly connected network, we have tested the irreducibility 
through the algorithm of Tarjan [56] It occurs that each matrix is reducible (i.e. 
not irreducible). In fact, beside a giant strongly connected component, there 
are many other (even single) units that stand alone as if strongly connected 
components for its neighborhood. This is due to the fact that the "sample" 
reports authors that either only quote or are only quoted. Therefore, reversal 
links are missing, increasing thereby the number of strongly connected com- 
ponents. Therefore, extensions of the Perron-Frobenius theorem to irreducible 
matrices cannot be applied since each matrix Mo, Co, Do, Fq reducible. 

Of course, the Perron-Frobenius theorem for irreducible matrices could be 
applied on each single strongly connected component, - locally, w mean. How- 
ever, it seems that this would give a (too) local result on the eigenvalue for all the 




(13) 



F , i.e. 




(14) 
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short dimension sub-matrices. We have considered that it would not be useful 
for the present purpose, - nor to the global task of understanding the relevance 
of authors, - since the property of irreducibility is only interesting, in our opin- 
ion, for considering the strongly connected components. However, the strongly 
connected components may help in understanding the existence of " hubs" , clus- 
ters and clubs, - if such is a question. Therefore, the Perron-Frobenius theorem, 
applied in its version for non-negative matrices only, indicates that there may 
exist eigenvalues of the same absolute value as the maximal one; moreover the 
maximal eigenvalue may not be a simple root of the characteristic polynomial, 
can be zero (and the corresponding eigenvector does not need to be strictly 
positive). 

The EVs of the above 4 matrices, M , Co, D , and F , have been computed. 
The EVs of interest are given in Tables 1-3. Some information "summarizing" 
the structure of the EVs distribution is given in Table 5. The values of the 
CIE are also given in Table 4, from which the real part, imaginary part, abso- 
lute value and phase factor of H could be deduced depending on the defining 
Riemann sheet. 

3.2 Discussion 

First, note some apparent similarity between the characteristics of the whole 
network and of the two subnetworks from Table 4. The ratios between the 
number of directed (DL), undirected (UL) or total number (L) of links are 
rather similar, - the DL/L ratio being a little bit larger for Cq. 

Moreover, each largest EV is real and positive. The second largest EV can 
be either positive, like in Mq and Do, or complex, like in Cq and Fq. 

Recall that the real part of the main eigenvalue of an adjacency matrix is 
usually considered to be a measure of centrality of some node, like a leading 
agent. What is new here concerns the imaginary part which, as we consider, 
indicates the relative (inverse) scale or range of influence of such a leader. 

The information entropy, deduced from the calculated EVs, enhances some 
difference between the networks, going beyond consideration on the "main 
node", or "state" in a thermodynamic language. The real and imaginary parts 
of information entropy values for the matrices are presented in Table 4. First, 
one notes that Hi values are all of the same order of magnitude. Next, it is ap- 
parent that 1 1 if 1 1 are quasi similar whatever the used Riemann sheet, but more 
interestingly that the M and D n values differ from those of Co and F . Yet, 
the Do || value is very small and quasi equal to 0, in using the PV space. 

H is markedly different for C'o and for the other matrices. In fact, the real 
part of the IDP network entropy H is the only one to be positive, - but small. 
The other real parts are negative, in both spaces. In all cases, H is negative. 

Recall that the size of the matrices has been taken into account through the 
Im factor in the EV normalization. 

Rather than spending more time on the numerical values, it seems more 
useful to stress the origin of such a complex information entropy as arising 
through the network structure. The key feature appears to be the ensemble of 
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so called simple transitivity paths, as illustrated in App. C on small networks. 
This observation might also help in future deep mathematical work in order 
to sort out the property of EV distributions of random matrices. In fine, the 
complex part of the entropy truly emphasizes the delay in information, the 
citation sequence, and range of information, the connected nodes. In so doing, 
it seems that the CIE has brought a vision of directed networks different from 
other measures and other previous discussions, like one in [57], but considering 
acyclic networks. 

4 Conclusions 

Directed networks are very common. Citation networks belong to a huge sub- 
class of those. It is common knowledge also that opinion formation demands 
information exchanges which are thereby necessarily "directed" between agents. 
When representing such networks through adjacency matrices, it is apparent 
that such matrices are necessarily asymmetric. 

This paper, on one hand, introduces a technique in order to obtain some 
insight into directed networks. It appears that one can consider a network infor- 
mation entropy through the link distribution on which information is exchanged. 
Through an analogy with Boltzmann entropy in usual statistical mechanics, one 
can observe that in order to get more insight on the network entropy, one can 
calculate the whole set of eigenvalues of the adjacency matrix of the network. 
This is similar to consider the set of discrete values of a transfer matrix in quan- 
tum or statistical mechanics. However, the resulting information entropy turns 
out to be a complex mathematical feature. It needs some interpretation 1 . The 
latter can be based on the free energy concept. 

Starting form the notion of equilibrium free energy, Zweger [58] attempted a 
dynamical interpretation of a classical complex free energy, in 1985. He pointed 
out that the problem is to determine a characteristic " relaxation" time for some 
process in which the dynamical (Langevin or Fokker-Planck) equation is con- 
nected to some Hamiltonian or some corresponding transfer matrix. A proba- 
bility current can be written, in fact, in terms of some unstable mode times an 
equilibrium factor which is the imaginary part of the free energy [59]. Usually 
[58, 60], the imaginary part of the free energy (or largest eigenvalues) give some 
information about the "nucleation stage" of the dynamics. The real part, of 
course, determines the equilibrium energy state. 

We propose that another, though related approach, can be considered. In- 
stead of some " relaxation time" , one may consider the " spatial aspect of the 
phenomenon", e.g. through some correlation range length £. This approach 
makes some sense, in particular for networks, analytically described through 

A reviewer suggested that "it would be fair, to indicate which branch is better or worse in 
possible applications/interpretations". This interesting point, however, sends back the reader 
to wonder what Riemann sheet is used in numerical algorithms, - ... different ones, as we have 
alas observed reconciling various calculations, whence inducing the extensive reports in Sect. 
2.2.1 and 2.2.2, surely serving as warnings 
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sonic Hamiltonian or transfer matrix. Moreover, such a spatial scale intro- 
duction may remind of some analogy with Discrete Scale Invariance (DSI) (or 
lack of DSI) feature [19, 20]. In fact, this DSI leads to complex dimensions and 
complex critical exponents. 

The illustrating example implies two distinct communities, with markedly 
different opinions : the Neocreationist and Intelligent Design Proponents (IDP) 
on one hand, and the Darwinian Evolution Defenders (DED) on the other hand. 
These are communities for which an opinion consensus can be hardly expected. 
It appears that for the whole set of agents, two agents ("states") are markedly 
dominating. They seem to belong to the DED community. In contrast, the IDP 
community has only one main " state" . Interestingly, the same is true for the 
inter-community " information exchange phenomenon" for which there is only 
one main dominating state. 

In summary, we have presented an original work extension of IE, connect- 
ing the CIE method, to sound statistical mechanics. By examining, different 
eigenvalues of asymmetric matrices, - sometimes complex eigenvalues, yet start- 
ing with the largest ones, one can describe an IE, - like if in thermodynamics, 
one describes a free energy in terms of eigenvalues of some Hamiltonian. Thus, 
one not only obtains the "basic" free energy, but also corrections due to some 
underlying scale structure. Moreover considerations on the mathematical form 
of the IE, i.e. its real and imaginary part, when they exist, allow to emphasize 
characteristics, which we attribute to the leadership range. This has been exem- 
plified by considering a network with two specific communities having different 
opinions, exchanged through citations. 

Note added at the completion of this report: Another argument in 
favor of studying asymmetric matrices can be mentioned. Indeed, during the 
process of finishing up the present work, for submission, a paper, submitted to 
to EPJB, occurred on arXivcs [61] entitled Asymmetric correlation matrices: an 
analysis of financial data. Due to the asymmetry in time delayed correlations 
between financial time series, it is indeed also of interest to extend the spectral 
analysis to the realm of complex eigenvalues, - as first attempted in [62]. Though 
different in essence, such works and the present one indicate that one should 
not be stacked to studying only systems within real algebra. 
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Appendix A. Normalization considerations 



In the main text, the Theil index form [22] 



has been adapted from its original writing, with real numbers, to one involving 
complex numbers, but the more so better appropriate for the IE, i.e., 

Im \ 

rEp as) 

2 — 1 

with the "normalization" Im- Indeed, it would have been inappropriate to use 

Im 

the Theil index original normalization, since < A, >= 0, because Aj = 0. 

i=i 

Appendix B. Tsallis entropy 

Tsallis [63, 64, 65] proposed that a large category of systems may be treated 
by a similar formalism, but where a more general entropy measure is defined by 

S q = k B (1 - y } (17) 

which depends on the real parameter q and which reduces to the Shannon en- 
tropy for q — >1. Along the lines in the main text, it is tempting to define a q IE 

as 

i+^i-Dfr) as) 

thereby accepting a complex-valued IE in Tsallis sense. 

Tsallis theory is sometimes referred to in the literature as no-extensive sta- 
tistical mechanics, in contrast with the extensivity of the Shannon entropy. For 
general q, a proper extremisation of Eq.(17) leads to generalized canonical dis- 
tributions, often called Tsallis distributions, 

'' w - Si (19) 

where x denotes the energy of the system, Z s (q) = Y,^ 1 e~ H ( s ' ly ' >9 , and is the 
g-exponential function defined by 

e* = {l + {l-q)x)^. (20) 

One should also note that Tsallis formalism draws a direct parallelism with 
the equilibrium theory, where (3 plays the role of the inverse of a temperature, 
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and Z that of a partition function. However Tsallis and others [63, 64, 65] have 
often insisted ion the connexion between q- and non-equilibrium effects. One 
might consider connecting the above IE to Tsallis considerations, in further 
work; see already [66]. Recall that a q— Thcil index has been already introduced 
[67, 68]. 

Appendix C. A 3x3 matrix 



Let a state Hamiltonian be described by a 3x3 matrix 



H 





H12 


H13 




#22 


H23 


Hi 3 


H23 


H33 



(21) 



To remain within a "no self-citation" scheme, let all the diagonal elements be 
equal to zero, i.e. Hn = H 2 2 = H33 = 0, and call this "new" matrix Ho- More- 
over, let all non diagonal elements be equal to either 1 or 0. These "reductions" 
are made in the spirit of tying the present subsection to the main text, involv- 
ing a ("large") citation network for which the (adjacency) matrix has elements 
taking only a 1 or value. 

Recall that the EVs of any 3x3 matrix are solutions of the cubic equation 

-A 3 + A 2 tr(H ) + ^{tr(H ) 2 - tr 2 (H )} + det{H ) = 0. (22) 



By "construction", tr(Ho) = tr 2 {H. ) = 0. Moreover, one easily obtains 
that tr(H a ) 2 /2 = H 12 H 2 i + H 13 H 31 + ff 23 iJ 3 2, and det(H Q ) = H 13 H 32 H 21 + 
H3\H\ 2 H 23 . Therefore, only 7 types of cubic equations, as Eq.(22), have to be 



considered 






• 


type I : 


-A 3 + 3A + 2 = 





• 


type II : 


-A 3 + 2A + 1 = 


= 


• 


type III : 


-A 3 + A + l = 





• 


type IV : 


-A 3 + A + = 





• 


type V : 


-A 3 + 2A + = 


= 


• 


type VI : 


-A 3 + 0A+ 1 = 


= 


• 


type VII 


: -A 3 + 0A + 


= 



It is somewhat easily deduced that only type III and type VI lead to complex 
eigenvalues. Both types have one positive real root. Note that the type I cubic 
equation has a real negative (of course evenly) degenerate root = -1, requesting 
special attention when calculating H; see end of Sect. 2.2. 

The networks made of three nodes corresponding to such cubic equations are 
illustrated in Fig. 5, - one network is displayed for each case only; the others 
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are easily and readily deduced by permutation of bonds [69, 70, 71]. On one 
hand, this illustrates well why type I has degenerate eigenvalues. On the other 
hand, the complex eigenvalues (type III and type VI) are now understood as 
arising from the transitivity relationship, corresponding to 14-120C and 9-030T 
triads, in Pajek Manual notations [72]. 

Even though it might look surprising to describe 3x3 matrices in a modern 
scientific paper, the present illustration has been found necessary as the most 
simple one leading to some appreciation of the EV behavior of larger random 
matrices. 
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M 






M 






EV rank 


Re 


Im 


EV rank 


Re 


Im 


1 


7.1039 




62 


-0.0000 


-0.0000 


2 


1.4849 




63 


-0.3350 




3 


1.0758 


0.7077 


64 


-0.3461 


0.6531 


4 


1.0758 


-0.7077 


65 


-0.3461 


-0.6531 


5 


0.7763 




66 


-0.4422 




6 


0.5693 


1.3660 


67 


-0.4524 


1.1900 


7 


0.5693 


-1.3660 


68 


-0.4524 


-1.1900 


8 


0.4919 


0.5775 


69 


-0.6560 




9 


0.4919 


-0.5775 


70 


-0.7323 


0.6917 


10 


0.3214 


0.3474 


71 


-0.7323 


-0.6917 


11 


0.3214 


-0.3474 


72 


-1.5661 


0.5212 


12 


0.1506 


0.5245 


73 


-1.5661 


-0.5212 


13 


0.1506 


-0.5245 


74 


-1.5739 


1.2422 


14 


0.0000 


0.0000 


75 


-1.5739 


-1.2422 




0.0000 


0.0000 


76 


-1.9041 


0.1983 


61 


-0.0000 


-0.0000 


77 


-1.9041 


-0.1983 



Table 1: Real (Re) and Imaginary (Im) part of each eigenvalue (EV) of the Mo 
matrix ranked in increasing rank order according to the Re part. Not all EVs 
= are given. 
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Figure 1: Distribution of the eigenvalues (EVs) of the matrix Mq in the complex 
plane 
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Figure 2: Distribution of the eigenvalues (EVs) of the matrix Co in the complex 
plane 



1 

E 
0.5 



E 



O 

E 



-B-B^Q-THB- 
-1 



-0.5 



B 



-1 



B 

Re EVC 



21 



Figure 3: Distribution of the eigenvalues (EVs) of the matrix Dq in the complex 
plane 
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Figure 4: Distribution of the eigenvalues (EVs) of the matrix F in the complex 
plane 
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-0.8 

Re EVF 



Figure 5: Networks of triplets, according to Pajek Manual notations, corre- 
sponding to different types of cubic equations as given in the main text; only 
one network is shown per type of equation; the others can be obtained by per- 
mutation. 




Co 






D 






EV rank 


Re 


Ira 


EV rank 


Re 


Ira 


1 


3.054 




1 


3.744 




2 


0.4714 


0.9238 


2 


1.4677 




3 


0.4714 


-0.9238 


3 


0.4907 


0.9230 


4 


0.3349 




4 


0.4907 


-0.9230 


5 


0.0000 


0.0000 


5 


0.3213 




6 


0.0000 


0.0000 


6 


0.0000 


0.0000 




0.0000 


0.0000 




0.0000 


0.0000 


32 


0.0000 


0.0000 


32 


0.0000 


0.0000 


33 


-0.4441 


0.7369 


33 


0.0000 


0.0000 


34 


-0.4441 


-0.7369 


34 


-0.5423 


0.4902 


35 


-0.7072 




35 


-0.5423 


-0.4902 


36 


-1.0000 




36 


-0.5441 




37 


-1.7363 




37 


-1.0789 


0.8657 








38 


-1.0789 


-0.8657 








39 


-1.3640 


0.0572 








40 


-1.3640 


-0.0572 



Table 2: Real (Re) and Imaginary (7m) part of each eigenvalue (EV) of the Co 
and Do matrix ranked in increasing rank order according to the Re part. Not 
all EVs = are given. 



^0 






1 F ° 






EV rank 


Re 


Ira 


EV rank 


Re 


Ira 


1 


3.8191 




73 




0.7097 


2 


0.7411 


0.2997 


74 




-0.7097 


3 


0.7411 


-0.2997 


75 


-0.7411 


0.2997 


4 


0.000 


0.000 


76 


-0.7411 


-0.2997 




0.000 


0.000 


77 


-3.8191 





Table 3: Real (Re) and Imaginary (Ira) part of each eigenvalue (EV) of the i*b 
matrix ranked in increasing rank order according to the Re part. Not all EVs 
= are given 
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number of 




M 


C 


Do 


^0 


nodes (Im) 




77 


37 


40 


77 


links 




281 


91 


71 


119 


directed links 




219 


79 


51 


89 


undirected links 




31 


6 


10 


15 


finite EVs 




28 


9 


12 


8 


EV = 1 
















EV = 




49 


28 


28 


69 


EV : -1 










1 





real,deg. EV / 
















p Re > 




3 


2 


3 


1 


i/ i?e < 




3 


3 


1 


1 


a Im > 













1 


a Im < 













1 


A, c.c. £V 




11x2 


2x2 


4x2 


3x2 


(Ai/W) ln[A!/W] 




-0.2199 


-0.2059 


-0.2217 


-0.1490 


Hi 




0.7801 


0.7941 


0.7783 


0.8510 


H TC 




+0.2655 


+1.0731 


+0.3366 


+0.8671 


tt" 

n TC 




-0.4568 


-0.2877 


-0.4346 


-0.2132 


H PV 




-0.3889 


+0.7911 


-0.03040 


+0.7603 


H PV 




-0.1328 


-0.2924 


-0.04273 


-0.2422 



Tabic 4: Pertinent characteristics of studied matrices 
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